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Statement of Research Accomplished 


During the period December 1 5 » 1972 to June 15, 1973 all work was 
concentrated on the definition and evaluation of a measure of performance 
for code-decoder combinations. The following results were obtained: 

• . The definition of a performance measure for both block and 
c evolutional codes which takes into account the amount of 
"edu.idancy in the code, the amount of data rejected by the 
decoder, the accuracy of the data after decoding and the 
relative importance of the last two factors. 

2. The evaluation of the above performance measure for two 
types of '.amming codes of block length n * 7* 15, 31, 63, 

127, 255- 511, 1023 used over the binary symmetric channel 
and decoded by various algorithms. 

3. A graphical comparison of the performance of these codes 
and an uncoded transmission system, as a function of the 
channel signal-to-r.oise ratio. 

A detai led description of these results is appended. 
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I. Introduction and Summary 

Although the use of error control coding techniques in digital space 
communication systems has become fairly routine in recent years, there 
still exists a great deal of uncertainty as to the actual effectiveness 
of coding in achieving more reliable communication. The reason for this 
is to be found in the fact that the commonly used performance parameters 
do not take into account all the pertinent aspects of the coded trans- 
mission system. Thus, for example, the widely used Probability of Word 
Error criterion totally ignores tne possibility that the decoder may in- 
corporate some degree of data rejection. Likewise, the minimum distance 
criterion, another popular measure of code performance, is completely 
independent of the decoding algorithm and several other important system 
factors . 

As a consequence of this state of affairs, it is virtually impossible 
to compare, say, a coding system with error correction and data rejection 
to one with error correction alone, using any of the existing criteria of 
performance, and it is therefore of value to define and evaluate measures 
which incorporate most, if not all, of the quantities affecting the over- 
all system reliability. This is the objective of the present work. 

II. Definition of Performance Measure 

For the simple types of block codes normally employed in space com- 
munication systems, the complexity of the encoder and decoder is e £ little 
consequence, since the use of integrated circuit technology allows the 
construction of the basic components in an inexpensive fashion. Further- 

« 

more, the complexity is essentially independent of the particular code- 
decoder used. 

The processing speed is generally a function of the type of logic 
used and the technology in the construction of the integrated circuits. 



Although one could probably obtain cost figures as a function of processing 
speed, the importance of these costs in the overall system considerations 
is difficult to assess. Also, as with complexity, processing speed is not 
a strong function of the code-decoder combination. 

Thus, the important factors determining the overall coding system per- 
formance are: 

1. The accuracy of the data after decoding, 

2. The amount of data rejected by the decoder, 

3. The amount of redundancy in the code, and 

A. The relative importance of data accuracy, data 
rejection, and data transmission rate. 

Let us consider a situation in which N blocks of received digits from 
a binary (n, k) block code are to be decoded. The decoder generally rejects 
N-X blocks, leaving X blocks after decoding, of which Y are correct, (see 


Figure 1). 
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FIGURE 1. GENERAL DECODER CONFIGURATION 


The amount of redundancy in the code is measured by the quantity 

F m Jt m number of data digits per block 
1 n total number of digits per block * 

the amount of data rejected by che decoder is measured by the quantity 
F 2 - ^ E(X} , 

and the accuracy of the data after decoding is measured by the quantity 




Here E is the usual expectation operator. 

We also define a quantity 0 < a < 1 which measures the relative 
importance of data accuracy and data rejection. 

As an overall measure of performance of the code-decoder combination, 
we then take the function 

F = Fj (aF 2 + (l-a)F 3 } . 

When the N blocks are transmitted independently of each other and 
are treated as such by the decoder, F 2 reduces to the prob . ility of word 
rejection. For a decoder with no data rejection, F 3 becomes the proba- 
bility of correct decoding. The quantity a depends on the particular 
circumstances and is normally determined by the nature of the data. Small 
values of a correspond to a heavy emphasis on post decoding data accuracy, 
whereas large values of a imply emphasis on low rejection rates. In the 
next section, we evaluate F for a number of specific codes used over the 
binary symmetric channel. 


Evaluation of F for Hamming Type Block Codes 

We assume that N blocks are transmitted independently and with equal 
probability over a binary symmetric channel whose digit error probability 
Is p = 1-q. The codes of interest are of two types: the standard (n, k) 

Hamming code described by the parity check matrix 

fo 0 . . l] 

0 0 . . .11 


0 1 . . 1 

0 0 . . . ij 


whose columns are all 2 m -l nonzero binary m-tuples (m any integer greater 
than 2), and a modified Hamming code whose parity check matrix differs 
from the above only In having an additional row of ones on top. The first 



code has block length n = 2 m -l, k = n-m information digits and minimum 
distance 3 and is thus able to correct all single errors. The second code 
has the same block length, k = n-m -1 and minimum distance k and can be 
decoded in either a single-error-correcting, double-error-detecting mode 
or a triple-error-detecting mode. 

For both codes, the first step in decoding a received block v = (vj, 
v 2 ,...v n ) consists of determining its syndrome. This is a binary (n— k) — 
typle given by 



where T denotes matrix transposition and the multiplication and addition 
operations are modulo 2 . 

We now consider four cases, including, for purposes of comparison, 
the uncoded transmission of data blocks of length n. 

Case 1. No Coding - (n, n) Code 

Decoding Rule: Pass every block unchanged 

Evidently, X * E{X} = N and since a block is correct at the 
decoder output if and only if it is correct at the input, we 
have E{ Y> * Nq n 
Hence Fj = 1 ; F 2 = 1 ; F 3 - q n 
and 

F * a + (l-a)q° 

Case 2. Single-Error-Correcting Hamming Code 

Oecoding Rule: if the syndrome is zero, pass the block. If 

the syndrome is not equal to zero, assume a single error has 
occurred, correct it, and then pass the block. 

. Again* E{X} = N. For E{ Y } we have 

E{Y} * N{Probabi 1 i ty that a block has no error or a 
single error before decoding} 

» N{q n + nq n ~ l p} 



Case 3 


Case k 


Therefore, F x * - — , F 2 ■ I, F3 ® q n + nq n ' p 
and 


F ■ {a + (l-a)(q n + nq n 1 p)> 

Single-Error-Correcting, Double-Error-Oetecting Hamming Code 
Decoding Rule: If the syndrome is zero, pass the block. If 

the first digit and at least one of the remaining digits in the 
syndrome are one, assume a single error has occurred, correct 
it, and then pass the block. For ail other syndromes, reject 
the block. 

We have Fj ■ ■ n - tn — - , 
n 


F{Y> 

F 2 ■ -jj — = {Probability that a block has zero syndrome 
or the first and at least one of the re- 
Sli. maining digits equal one} 

V 1 r. n-2! 2i r , « . » -5 n-2J + 1 21 + I. 

{A 2i q P £' 2 ' ' A 2i + 1 J q p } 

i=0 

where Aj is . e number of codewords of weight j of the Single- 
Error-Correcting Hamming Code, 


and for F> we obtain 

1 
F 


F3 = {Probability that a received block is correct 


or has a single error} 
Triple-Error-Detecting Hamming Code 

Decoding Rule: If the syndrome is zero, pass the block. Other- 

wise, reject the block. 

Here «- n " m ■ , 


n 

E{X} 

N 


'{Probability th^t a block has zero syndrome} 


n-1 

2 

■S 


a _a-2i 2i 
P 



The Hamming code weight spectra required for Cases 3 and 4 may be 


obtained as the coefficients of the polynomial. 

n-1 n+1 

f(x) * {(l+x) n + n(l+x) 2 (1-x) 2 } 

where A. is the coefficient of x*. 

Numerical Results 

In Figures 2-49, we have plotted the performance measure F as a function 
of the signal-to-noise ratio of the binary symmetric channel in db, for all 
four cases described above, and for n * 7* 15» 31* 63, 127, 255, 511, 1023, 
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